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Abstract 

Purpose This article summarizes student performance and sur¬ 
vey data from a recent massive open online course (MOOC) on 
life cycle assessment (LCA). Its purpose is to shed light on 
student learning outcomes, challenges, and success factors, as 
well as on improvement opportunities for the MOOC and the 
role of online courses in LCA education in general. 

Methods Student survey data and course performance data 
were compiled, analyzed, and interpreted for 1257 students 
who completed a pre-course survey and 262 students who 
completed a post-course survey. Both surveys were designed 
to assess student learning outcomes, topical areas of difficulty, 
changing perceptions on the nature of LCA, and future plans 
after completing the MOOC. 

Results and discussion Results suggest that online courses 
can attract and motivate a large number of students and equip 
them with basic analytical skills to move on to more advanced 
LCA studies. However, results also highlight how MOOCs 
are not without structural limitations, especially related to 
mostly “locked in” content and the impracticality of 
directly supporting individual students, which can create 
challenges for teaching difficult topics and conveying 
important limitations of LCA in practice. 
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Conclusions Online courses, and MOOCs in particular, may 
present an opportunity for the LCA community to efficiently 
recruit and train its next generations of LCA analysts and, in 
particular, those students who might not otherwise have an 
opportunity to take an LCA course. More surveys should be 
conducted by LCA instructors and researchers moving for¬ 
ward to enable scientific development and sharing of best 
practice teaching methods and materials. 

Keywords Education • Life cycle assessment • Massive open 
online course • Pedagogy 

1 Introduction 

Life cycle assessment (LCA) is used to support many types of 
environmental decisions, across a broad range of disciplines, 
and within nearly every economic sector. Despite LCA’s 
widespread use, the literature on pedagogical approaches in 
LCA and the experiences of LCA instructors and students is 
decidedly sparse (Cooper and Fava 2000a, b; Evans et al. 
2008; Lin et al. 2012). As LCA practice grows, there is a 
pressing need for more research on the efficacy of different 
LCA teaching methods with respect to specific learning ob¬ 
jectives and student characteristics. Such research could help 
the LCA community better educate and inspire its next gen¬ 
erations of LCA analysts by facilitating scientific develop¬ 
ment and sharing of best practice teaching methods and 
materials. 

This article takes a small step toward closing this research 
gap by summarizing student performance and survey data 
from a recent massive open online course (MOOC) on LCA 
(Masanet 2014). The course was designed to provide a basic 
yet broad overview of the LCA methodology to online stu¬ 
dents with elementary quantitative skills and from any disci¬ 
pline. Its primary aims were to introduce LCA to students who 
might not otherwise have access to an LCA course, to provide 
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them with hands-on LCA experience, to inspire them to 
pursue more advanced LCA studies, and to equip them with 
a basic analytical foundation with which to do so. 

Core topics included mass and energy balancing, unit 
process inventory constmction and scaling, goal and scope 
definition, life cycle inventory (LCI) compilation, life cycle 
impact assessment (LCIA) (using TRACI 2.0 (Bare 2011)), 
cutoff criteria and multi-functionality approaches, and inter¬ 
pretation and reporting. These topics were taught with refer¬ 
ences to major LCA standards and guidelines—including the 
ISO 14040 series and the International Reference Life Cycle 
Data System (ILCD) Handbook (European Commission 
2010)— to reinforce best practices. The 9-week course was 
hosted on the Coursera platform and ran from January to 
March 2014 (Coursera 2014). The MOOC consisted of 27 
lecture videos (three per week), nine weekly homework as¬ 
signments, in-video quizzes, a course project, and interactions 
between instructors and students via online discussion forums. 
The course project allowed for hands-on application of LCA 
to a simple and familiar product: a bottled soft drink. Students 
were required to build and interpret a complete LCA 
model of a bottled soft drink in a spreadsheet, using 
LCI data provided by the course instructors, and in a step- 
by-step fashion aligning with each week’s topical area and 
homework results. 

Over 17,000 students enrolled in the course. Of these, over 
1200 viewed all lecture videos, over 2300 turned in one or 
more homework assignments, and over 700 ultimately passed 
the course. Such low retention and completion rates are typical 
of most MOOCs, in which many students enroll but far fewer 
engage in the course materials (Ho et al. 2014). Nearly 2500 
students completed a voluntary pre-course survey, which 
gathered data on their backgrounds, skills, motivations, and 
expectations entering the course. Findings from the pre-course 
survey are summarized in (Masanet and Chang 2014, in 
press). Of those who finished the course, 262 completed a 
voluntary post-course survey, which gathered data on their 
course experiences and future plans. These two voluntary 
surveys were not designed for rigorous statistical analysis, 
but rather to identify broad characteristics among the student 
body. This article combines pre- and post-course survey data 
with course performance data to shed light on student per¬ 
spectives, challenges, and success factors, as well as improve¬ 
ment opportunities for the MOOC. 

2 Retention and performance 

The pre-course survey revealed a wide variety of fields of 
training among the student body (Masanet and Chang 2014, in 
press). Figure 1 plots the weekly retention and course com¬ 
pletion percentages of students by primary field of training, as 
well as the primary fields of training of those students who 


received a passing grade (in the chart inset). A passing grade 
required a cumulative homework score of 70 % correct an¬ 
swers. The cohort size for the retention plots in Fig. 1 is 1257, 
which is the number of students who identified their primary 
field(s) of training in the pre-course survey and completed one 
or more weekly homework assignments (including homework 
1). The cohort size of passing students in the chart inset is 504, 
which is the number of students who identified their primary 
field(s) of training in the pre-course survey and received a 
passing grade. Overall, 39 % of students in the cohort com¬ 
pleted the course with a passing grade, as indicated by the bold 
black line in Fig. 1. As with most MOOCs, weekly drops in 
student retention were most severe earlier in the course. 
However, the data in Fig. 1 show that students from predom¬ 
inantly quantitative fields (engineering, environmental sci¬ 
ences and ecology, business and economics, and basic sci¬ 
ences) exhibited higher retention over the duration of the 
course than those from traditionally less quantitative fields 
(e.g., social sciences, public policy, humanities, journalism, 
and law). 

Figure 2 plots the percent of students passing the course by 
level of quantitative skill for the same cohort as Fig. 1. In the 
pre-course survey, students were asked to assess their experi¬ 
ence with six different quantitative tasks that were central to 
the learning and application of LCA methods in the MOOC. 
Most students indicated at least some experience collecting 
and analyzing data, working with spreadsheets, and solving 
algebraic equations, which implied a reasonable quantitative 
baseline among the student body, while fewer students 
expressed proficiency with conducting mass and energy bal¬ 
ances. As the data in Fig. 2 show, there was a strong correla¬ 
tion between experience levels and pass rates: those who 
expressed “much experience” exhibited pass rates around 
10 % higher than those who expressed “little or no experi¬ 
ence” across all quantitative skills. Additionally, students who 
expressed “much experience” consistently performed better 
than those who expressed “some experience,” despite the 
basic quantitative level of the course and in particular for 
quantitative skills related to conducting mass and energy 
balances, solving algebraic equations, and working with 
spreadsheets. 

One explanation for these performance gaps might be that 
the combination of a fast-paced course (9 weeks), weekly 
quantitative homework assignments, and building a compre¬ 
hensive spreadsheet model proved too demanding for those 
with less confidence in their quantitative skills. So as not to 
discourage promising students from improving their quantita¬ 
tive skills to learn LCA, in future offerings, the MOOC’s 
duration will be extended and it will also offer additional 
resources for practicing and improving key quantitative skills 
along the way. Additionally, of all quantitative skills, the 
performance gap between experienced and non-experienced 
students was most pronounced for mass and energy balancing, 
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Fig-1 Course retention and 
completion by primary field of 
training 
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which was also the quantitative skill for which the fewest 
students indicated at least some experience. These results 
suggest there is a particularly strong need for improved ex¬ 
planations and training in the MOOC with respect to 
conducting mass and energy balances. 

The data in Fig. 2 also give evidence to some structural 
challenges of MOOCs in general. First, by nature, a MOOC’s 
content is largely “locked in” prior to the launch of the course, 
which makes it difficult to adapt content based on feedback 
from struggling students along the way as can be done in a 
traditional classroom. For example, only one brief lecture was 
devoted to mass and energy balancing, which was probably 
not sufficient given the lack of experience among students 
who ultimately enrolled in the course. Second, it is impractical 
for course staff to answer all questions in MOOC discussion 


forums, given thousands of enrolled students. Therefore, 
many less experienced students may not have received the 
support they needed to grasp key concepts as they would 
normally get in a traditional classroom. Third, although the 
MOOC listed clear prerequisites for basic quantitative skills, 
there is no mechanism for enforcement (i.e., anyone can 
enroll). Thus, it is likely that some enrolled students 
simply did not have the proper quantitative foundations 
to succeed in the MOOC, despite the explicit prerequi¬ 
sites. Moving forward, a key challenge is to find bal¬ 
ance between offering remedial quantitative training in 
the MOOC to equip and encourage capable students to 
pursue more advanced LCA studies and maintaining a 
minimum level of quantitative rigor that is required for sound 
and credible LCAs. 


Fig. 2 Percentage of students 
passing by quantitative skill level 
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3 Topical difficulty ratings 

The post-course survey offered students an opportunity to rate 
the relative difficulty of learning and applying different core 
topics within the LCA methodology during the MOOC. The 
ratings were designed to assess student perceptions about core 
LCA concepts and to identify topical areas for which teaching 
methods could be expanded or improved in future offerings. 
Of the 262 students who completed the post-course survey, 
211 passed the course. Figure 3 plots the difficulty ratings 
reported by these 211 passing students in a radar chart, in 
which the bar colors correspond to difficulty ratings and the 
bar lengths correspond to the frequency of ratings for 11 
different core LCA topics. 

The distributions within each topical area shed light on 
overall perceived difficulty. Goal definition was the only topic 
that was predominantly rated as easy, while the topics of 
multi-functionality, input-output (10) LCI, LCIA, and prepar¬ 
ing results for ease of interpretation were predominantly seen 
as more difficult. Distributions were nearly evenly balanced 
between easy and difficult ratings for the remaining topics 
(e.g., functional unit and reference flow selection). 

Although teaching methods can always be improved for 
any topical area, the data in Fig. 3 suggest that such improve¬ 
ments should be prioritized for materials and methods related 
to the “difficult” topics in future offerings of the MOOC. 
While many LCA analysts would agree that multi-functional¬ 
ity, IO LCI, LCIA, and effective results preparation are com¬ 
plex and nuanced topics in practice, insufficient data exist in 
the literature to determine whether these topics are universally 
perceived as most difficult in LCA courses, or if these 


perceived difficulties can be attributed to the specific teaching 
methods and materials in the MOOC. Regardless, the 
MOOC’s structural challenges of limited time, limited direct 
engagement with many students, and mostly “locked in” 
course content likely contributed to greater perceived difficul¬ 
ties for these complex and nuanced topics. For example, due 
to time constraints, the MOOC focused mostly on applying 
LCIA characterization factors and IO LCI results with only 
limited coverage of the scientific and mathematical underpin¬ 
nings of the methods. Although students were referred to 
additional resources for more in-depth learning, this approach 
may have contributed to an incomplete grasp of these topics 
for many students and, subsequently, less confidence when 
applying these methods in their course projects. Perceived 
difficulties in preparing results for ease of interpretation may 
be an artifact of the course design, given that students had to 
construct result tables and graphs manually in their spread¬ 
sheet models (as opposed to generating them automatically 
using a commercial LCA software package). However, this 
element of the MOOC design was deliberate to encourage 
careful attention to—and continuous scrutiny of—modeling 
results and to develop skills in presenting data in ways that 
maximize utility to an LCA’s audience. The MOOC also 
devoted significant time to the topic of multi-functionality, 
including two lectures and two homework assignments that 
followed the ISO multi-functionality hierarchy. While multi¬ 
functionality can be challenging for even seasoned LCA an¬ 
alysts, the difficulty ratings in Fig. 3 suggest that even more 
coverage, hands-on exercises, and practice within the course 
project related to multi-functionality should be incorporated 
into future offerings of the MOOC. 


Fig. 3 Student difficulty ratings 
by LCA topical area 
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4 Shifts in perspectives? 

In addition to gauging perceived difficulties in learning 
core LCA topics, the post-course survey was designed 
to assess how student perceptions changed over the 
course with respect to the nature and role of LCA in 
environmental decision making. In the pre-course sur¬ 
vey, students were asked to agree or disagree with five 
broad statements about the LCA method, which are 
summarized in Fig. 4. In the post-course survey, stu¬ 
dents were asked if their answers to these questions 
would change due to their course experience. These 
questions were designed to assess how effective the 
course was at conveying important limitations of LCA 
in practice and at challenging any preconceived notions 
of LCA as a panacea for decision making (Curran 2013). 

The cohort for Fig. 4 consists of the 195 students who 
passed the course and completed both the pre-course and 
post-course surveys. Comparing the distributions of responses 
before and after the course sheds light on how overall student 
opinions changed on each broad statement. For example, there 
was a significant shift toward much stronger disagreement 
with the statement “LCAs are easy to conduct” after the 
course. This shift suggests that the course met its objective 
to demonstrate that sound and credible LCAs require lots of 
time, resources, data, documentation, and attention to detail. 
However, the shifts in Fig. 4 also suggest that the MOOC was 
less effective at convincing students that data are often scarce; 
that LCAs can be subjective; that results are typically uncer¬ 
tain; and that scientific validity depends heavily on chosen 
methods, data, and study design. These are broad impressions 
that seasoned LCA analysts have learned and reinforced 
through experience, which is a difficult process to replicate 
in a 9-week introductory MOOC. While the MOOC was 
designed to convey these limitations implicitly, most lectures 
and exercises were focused on core LCA methods without 
explicit and continuous reinforcement of such limitations over 
the duration of the course. For example, to demonstrate that 
LCAs can be subjective and based on flawed data and 


assumptions, students were asked to evaluate critiques of a 
debunked life cycle energy study of a Prius versus a Hummer 
(Gleick 2007; Hauenstein and Schewel 2007; Spinella 2007) 
and assess where the study fell short with respect to specific 
LCA best practices. However, as the final homework assign¬ 
ment, this exercise may have missed an opportunity to more 
strongly reinforce LCA’s limitations by teaching such limita¬ 
tions in parallel to the methods. In a traditional classroom, 
instructors can ensure such limitations are recognized through 
ad hoc discussions with students, which is not easily achieved 
in an online discussion forum. The data in Fig. 4 suggest that 
in a MOOC, such limitations should be made very explicit in 
the lectures and course materials with steady reinforcement 
throughout the course. 

To address these shortcomings, future improvements to the 
MOOC may include requiring students to gather some of their 
own LCI data to demonstrate data scarcity, evaluate differ¬ 
ences in subjective methodological decisions in published 
LCA studies, conduct uncertainty analyses in their course 
projects, identify examples of false precision in the LCA 
literature, and critique additional studies to identify deviations 
from best practices. These changes will necessarily lengthen 
the duration of the MOOC, but with the benefit of leaving 
students with more nuanced views of important LCA 
limitations before they move on to more advanced stud¬ 
ies. Despite these shortcomings, the MOOC appeared to 
be quite successful in fostering constructive skepticism 
among the passing students. In the post-course survey, 
when asked if they would approach future environmen¬ 
tal data and claims with more or less skepticism and 
scrutiny compared to when they started the course, 88 % of 
the cohort in Fig. 4 indicated they would be more skeptical 
and scrupulous moving forward. 

5 What is next? 

Figure 5 summarizes post-course survey responses regarding 
students’ future plans after completing the MOOC. The cohort 


Fig. 4 Student perspectives 
before and after the course 
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Fig. 5 Post-course student 
intentions 
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consists of 211 students who passed the course and completed 
the post-course survey. Students were asked six different 
questions to gauge their desires to further develop their LCA 
skills, to apply LCA in their decisions, and to continue their 
studies of the LCA methodology. These questions were aimed 
at assessing the efficacy of the MOOC at encouraging and 
equipping students to continue their studies and applications 
of LCA. 

The majority of passing students indicated a stronger desire 
to improve their quantitative skills, employ LCA in their 
personal and professional decisions, and continue on to more 
advanced LCA studies after taking the MOOC. Therefore, 
while there are certainly limitations to the MOOC in its 
original form as discussed in previous sections, it seemed to 
succeed in motivating students to further develop their LCA 
skills. 

These results suggest there might be a valuable role 
for MOOCs in recruiting and motivating students to join 
the field, after which they can move on to more ad¬ 
vanced LCA studies. Furthermore, passing students in¬ 
dicated a strong desire for additional MOOCs on ad¬ 
vanced LCA topics, which presents an opportunity for 
the LCA community to develop new online courses. 
When asked if they would enroll in a follow-on MOOC 
covering more advanced LCA topics, 87 % responded “yes.” 
Interestingly, while some students expressed increased 
desire to pursue a career as an LCA analyst, an equal 
number of students expressed less desire to do so after 
completing the MOOC. While the reasons for this out¬ 
come are not clear, the other responses indicate strong 
desires to utilize LCA methods and results moving 
forward, even if some of those students are no longer 
interested in conducting LCAs as a career choice. 
Therefore, it appears that the MOOC was successful in 
fostering enthusiasm and capabilities among the passing 
students for using LCA greater use in practice and in 


whatever ways make sense for their careers and core 
disciplines. 

6 Conclusions 

The MOOC experience described here suggests that online 
courses can play a key role in attracting and motivating a large 
number of students and in equipping them with basic analyt¬ 
ical skills to move on to more advanced LCA studies. 
However, MOOCs are not without structural limitations, es¬ 
pecially related to mostly “locked in” content and the imprac- 
ticality of directly supporting individual students, which in 
this cased created challenges for teaching difficult topics and 
conveying important limitations of LCA in practice. While 
future improvements will be made to address these shortcom¬ 
ings, in its first run, the MOOC seems to have met its primary 
aims of reaching and motivating many prospective LCA 
practitioners. Moreover, despite its low retention rates, the 
MOOC also succeeded in effectively teaching LCA basics to 
over 700 passing students and at their own convenience, 
which is equivalent to conducting 20 traditional in-person 
courses (with 35 students each). Therefore, MOOCs may also 
offer the LCA community with a highly efficient means of 
attracting and training its next generations of LCA analysts. 
Surveys like the ones summarized here are critical for shed¬ 
ding light on the strengths and weaknesses of different peda¬ 
gogical approaches, including this MOOC. Such surveys 
should be conducted by more LCA instructors and researchers 
to foster greater knowledge sharing moving forward, especial¬ 
ly given the growing demand for LCA practitioners in 
many economic sectors. The survey data collected dur¬ 
ing this MOOC suggest that there is a significant op¬ 
portunity for more online courses on advanced LCA 
topics. How online courses contribute to the advance¬ 
ment of LCA pedagogy and educational opportunities 
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remains to be seen, since MOOCs are a recent phenom¬ 
enon. However, the broad reach and reasonable success of 
this MOOC suggest that there is both a valuable role and a 
strong demand for such courses moving forward. 

Open Access This article is distributed under the terms of the Creative 
Commons Attribution License which permits any use, distribution, and 
reproduction in any medium, provided the original author(s) and the 
source are credited. 
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